About me

Welcome! I am an Assistant Professor in the Department of Computer Science and Engineering at the University of Louisville. I received my PhD in Information Sciences and Technology from the Pennsylvania State University in 2023, Bachelor’s and Master’s degrees from Tsinghua University.

My research interests span the areas of computer vision, machine learning, human-computer interaction, and robotics. My research employs a hybrid approach integrating data-driven learning and human-centered design to address major human-centric challenges.

To Prospective Students

I am seeking motivated students interested in computer vision and/or human-computer interaction research. If you are a student at the UofL or in the Louisville area and wish to explore research opportunities, please email me.

Selected Recent Publications [Full List]

	Top2Pano: Learning to Generate Indoor Panoramas from Top-Down View Zitong Zhang, Suranjan Gautam, Rui Yu IEEE/CVF International Conference on Computer Vision (ICCV), 2025. [paper to appear]
	Describe, Adapt and Combine: Empowering CLIP Encoders for Open-set 3D Object Retrieval Zhichuan Wang, Yang Zhou, Zhe Liu, Rui Yu, Song Bai, Yulong Wang, Xinwei He, Xiang Bai IEEE/CVF International Conference on Computer Vision (ICCV), 2025. [paper to appear]
	Towards In-the-wild 3D Plane Reconstruction from a Single Image Jiachen Liu*, Rui Yu*, Sili Chen, Sharon X. Huang, Hengkai Guo IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025. 🌟Highlight Paper [paper][code] (*equal contribution)
	PlanarSplatting: Accurate Planar Surface Reconstruction in 3 Minutes Bin Tan, Rui Yu, Yujun Shen, Nan Xue IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025. 🌟Highlight Paper [paper][project]
	Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models Jingyi Xie, Rui Yu, He Zhang, Syed Masum Billah, Sooyeon Lee, John M. Carroll ACM Conference on Human Factors in Computing Systems (CHI), 2025. [paper][data]
	NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation Rui Yu*, Jiachen Liu*, Zihan Zhou, Sharon X. Huang IEEE International Conference on Robotics and Automation (ICRA), 2024. [paper] (*equal contribution)
	BubbleCam: Engaging Privacy in Remote Sighted Assistance Jingyi Xie*, Rui Yu*, He Zhang, Sooyeon Lee, Syed Masum Billah, John M. Carroll ACM Conference on Human Factors in Computing Systems (CHI), 2024. [paper] (*equal contribution)
	Be Real in Scale: Swing for True Scale in Dual Camera Mode Rui Yu, Jian Wang, Sizhuo Ma, Sharon X. Huang, Guru Krishnan, Yicheng Wu IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2023. [paper][code]
	Cascade Transformers for End-to-End Person Search Rui Yu, Dawei Du, Rodney LaLonde, Daniel Davila, Christopher Funk, Anthony Hoogs, Brian Clipp IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [paper][code]
	Helping Helpers: Supporting Volunteers in Remote Sighted Assistance with Augmented Reality Maps Jingyi Xie*, Rui Yu*, Sooyeon Lee, Yao Lyu, Syed Masum Billah, John M. Carroll ACM SIGCHI Conference on Designing Interactive Systems (DIS), 2022. [paper][video] (*equal contribution)
	Opportunities for Human-AI Collaboration in Remote Sighted Assistance Sooyeon Lee*, Rui Yu*, Jingyi Xie, Syed Masum Billah, John M. Carroll ACM International Conference on Intelligent User Interfaces (IUI), 2022. [paper][video][PSU News] (*equal contribution)
	Towards Robust Human Trajectory Prediction in Raw Videos Rui Yu, Zihan Zhou IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021. [paper][code]

Teaching

• CSE 419. Introduction to Algorithms
• CSE 619. Design and Analysis of Computer Algorithms

Services

• Conference Session Chair
  • Chair for IROS 2021 Session “Visual Tracking II”
• Conference Program Committee Member / Reviewer
  • IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, 2024
  • European Conference on Computer Vision (ECCV), 2024
  • IEEE International Conference on Robotics and Automation (ICRA), 2024
  • ACM Conference on Human Factors in Computing Systems (CHI), 2024
  • IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
  • AAAI Conference on Artificial Intelligence (AAAI), 2019, 2020, 2021
  • International Conference on Pattern Recognition (ICPR), 2018, 2020
• Journal Reviewer
  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • Pattern Recognition (PR)
  • Computer Vision and Image Understanding (CVIU)
  • Pattern Recognition Letters (PRL)
  • Journal of Visual Communication and Image Representation (JVCI)
  • Science China Information Sciences (SCIS)
  • Computerized Medical Imaging and Graphics (CMIG)